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ABSTRACT 

A citation analysis study examined the nature of 
sources cited in the articles published in five volumes of the 
"Journal of Agricultural Education 1 ' (JAE) during the decade 
1980-1990. Information was sought concerning the citation structure 
of the JAE over the 10-year period, the relative importance of types 
of citations referenced by authors publishing articles in the JAE, 
and the structure of the agricultural and extension discipline as 
indicated by self-identity and compactness. A systematic sample of 19 
issues comprising 162 articles was analyzed to accomplish the study 
objectives; citations were categorized according to Goldsmith's 
(1983) research. Some of the results of the study were the following: 
(1) the number of articles and the number of citations used have 
increased over the years, with the mean number of citations per 
article more than doubling; (2) agricultural educators are most 
likely to quote information from journals (26 percent), followed by 
books (24 percent), bulletins and reports (23 percent), dissertations 
and theses (13 percent), and magazines and conference proceedings (8 
percent); (3) the use of journals, books, bulletins and reports, 
dissertations and theses, and conference proceedings has increased 
over the years, and the use of magazines has declined; and (4) 
frequent citation of the same journals reveals that the discipline of 
agricultural education research appears to have a strong 
self-identity and that it is compact. The study concluded that 
agricultural educators and the JAE should branch out by conducting 
and publishing research in nontraditional areas of agricultural 
education and by examining and citing more research conducted in 
other disciplines. (Contains 18 references.) (KC) 
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^ Thirty-one volumes of the Journal of Agricultural Education (formerly AATEA Journal) 

have been published since 196L Over the years, the journal has undergone a number of changes 
in terms of size, format, content, frequency of publishing (from three issues to four in 1983) and 
yyn finally, a change in the name from AATEA Journal to the Journal of Agricultural Education. 

During the Journal's span of 31 years, a number of researchers have examined various 
research and publishing aspects in the agricultural education profession. The most prominent 
subjects discussed included: empirical analysis of the Journal of Agricultural Education during the 
eighties (Radhakrishna and Jackson, 1992); what topics were cited and who was cited (Moore, 
1991); reader opinions of the JAE (Newman, 1990 & Williams, 1982); statistical procedures used 
by agricultural educators in reporting research findings (Bowen, Rollins, Baggett & Miller, 1990; 
Mannebach, McKenna & Pfau, 1984; and Warmbrod 1986); and agricultural and extension 
education research published in terms of program area, area of focus, and scope (Crunkilton, 
1988). 

Researchers in other disciplines have also examined research and publishing aspects within 
their profession. The most notable publications reviewed included: the Journal of Consumer 
Research (Wind, 1977), the Journal of Marketing Research (Goldman, 1979), Journal of Applied 
Psychology (Cox, 1977) and Home Economics Research Journal (Goldsmith, 1983). Although 
the scholars in the agricultural education profession have addressed research and publishing 
activities in a variety of ways, literature is scarce with studies that analyzed the citation 
characteristics of agricultural educators. "Citations are a popular indicator of the behavior of 
scholars because they reflect on author's debt to earliei <"vks, constitute a statement as to which of 
these works are important, and are a means by which auu^rs anchor their work and relate it to 
earlier research" (Goldman, 1979, p. 485). In addition, citations may also reflect an author's 
scope of reading and their scientific interests (Berg, 1971; Broadus, 1967; & Crane, 1972). 

A number of researchers in various scientific disciplines have considered citation structure 
as a good indicator of the nature of scientific activity. In addition, citation structure also 
characterizes a field of study, defines its boundaries, and explains how a discipline is interrelated 
with other fields of study (Narin, Carpenter and Berlt, 1972). Prominent among the scholars who 
have analyzed citation structures within their discipline include: Goldman (\919)~ Journal of 
Marketing Research and Journal of Marketing, Broadus (1952)~American Sociological Review, 
Hamelman, Edward & Mazze (\912)~Finance Journals, and Goldsmith (19$3)~Home Economics 
Research Journal. These studies have concluded that scientists use various methods to disseminate 
their research findings. Journals and books were the most widely used methods for 
communicating research findings, followed by working papers, presentations at research meetings 
and conference proceedings. 

Findings from these studies also indicated that publications such as Journal of Marketing 
Research and Journal of Marketing, American Sociological Review and Finance Journals have a 
greater degree of self-identity than that of Home Economics Research Journal. A discipline is 
U> considered to have strong self-identity and compactness if a large proportion of the citations are 

rv) concentrated in journals related to that area or field of study (Goldman, 1979). For example, 

\u> Goldman (1979) reported tflat 41.5% of all citations in the marketing discipline were concentrated 

^ in two journals, ie, Journal of Marketing Research and Journal of Marketing whereas, only 16% of 
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the citations in the home economics discipline were from its two major journals, Home Economics 
Research Journal and Journal of Home Economics. 

OBJECTIVES 

In this paper, the researchers have attempted to examine the nature of sources cited (citation 
analysis) by the authors of articles published in five volumes of the JAE during the decade 1980- 
90. The objectives of the study were: 

1 . To determine the citation structure of the JAE over a 10 year period. 

2. To determine the relative importance of types of citations referenced by authors 
publishing articles in the JAE. 

3. To determine the structure of the agricultural and extension education discipline as 
indicated by self -identity and compactness. 



PROCEDURES 

A census of all articles published in the Journal of Agricultural Education (JAE) during 
the decade 1980-90 was considered for this study. Then, using a systematic sampling procedure, 
every 2nd year in the decade was selected for analysis. This resulted in the selection of the years: 
1982, 1984, 1986, 1988, and 1990. 

A total of 19 issues and 162 articles were analyzed to accomplish the study objectives. The 
selection of this decade and years for analysis was based on three criteria. First, die journal 
changed its publication from three to four issues per year, thus becoming a quarterly. Second, a 
scientific journal reflects the tastes and preferences of the editor, and the reviewers, as well as 
editorial policies. The JAE had three editors during this decade: John Hillison (1982-84), Kirby 
Barrick (1985-1988), Philip Buriak (1989-1991). And third, the Journal changed its name from 
Journal ofAATEA to Journal of Agricultural Education (JAE) in 1988. 

For categorizing citations, the classification of citations by Goldsmith (1983) was 
consulted. Goldsmith's classification includes: books, journal articles, doctoral 
dissertations/master's theses, conference proceedings and paper presentations, magazines, and 
bulletins and reports. Goldsmith's classification of citations was slightly modified to reflect our 
study needs. For example, dissertation abstracts were included in the dissertation and master's 
theses category. Staff studies, summary research reports, and ERIC documentation abstracts were 
included in the bulletin/reports category. The total number of citations per article, per issue, and 
per year were also determined. In addition, it was also determined how many citations were from 
the following types of publications: books, journal articles, doctoral dissertation and master's 
theses, paper presentations and conference proceedings, bulletins and reports. Frequencies, 
percentages and means were used to describe the data. 

RESULTS 

Research Q uestion # 1 

Scientists use a variety of methods to communicate their research findings. Thus, an 
attempt was made in this study to examine what sources agricultural educators are reading and 
using in their research. Data suggests that the mean number of articles cited has increased over the 
decade indicating a greater breadth of knowledge and reading among agricultural educators. 
Similarly, the number of articles published and the number of citations used has also increased 
over the years. During the sample years, the number of citations ranged from 4.52 per article in 
1982 to 1 1.2 in 1990, with an overall mean of 9.2. Furthermore, it appears that agricultural 



educators tend to refer fewer citations per article (9.2) as compared to home economists (16.9) 
(Goldsmith, 1983). 



Table! 

Average Number and Distribution of Articles and Citations hv Yea r and Total fl 980-9m 









YEAR 








1982 


1984 


1986 


1988 


1990 


Total 


Number of Articles 


19 


33 


35 


30 


45 


162 


Number of Citations 


86 


224 


314 


332 


506 


1462 


Average Number of 














Citations Per Article 


4.52 


6.79 


8.97 


11.06 


11.24 


9.02 



Research Question #2 & 3 

Agricultural educators are most likely to quote information from journals (26%), followed 
by books (24%), bulletins and reports (23%), dissertation and theses (13%), magazines and 
conference proceedings (8.3%). The use of journals has increased over the years. Similarly, the 
use of books, buUetWreports, dissertations/theses and conference proceedings has increased. 
However, the findings indicate a decline in the use of magazines by agricultural educators. 



Table 2 

Number and Percentage Distribution of Citations bv Tvpe.Year and Total (\ 980-9ffl 



Citation Type 


1982 


1984 


YEAR 
1986 


1988 


1990 


Total 


Percent 


Journals 


18 


41 


69 


87 


162 


377 


26.0 


Books 


13 


57 


94 


73 


119 


356 


24.0 


Bulletins/Reports 


28 


57 


59 


79 


112 


335 


22.9 


Dissertation/Theses 


23 


39 


33 


38 


54 


187 


13.0 


Magazines 


1 


24 


46 


32 


19 


122 


8.3 


Papers/Proceedings 


3 


6 


13 


23 


40 


85 


5.8 



Since more than 25% of the sources cited by agricultural educators are from journals, it is 
important to know what journals are being used by agricultural educators. The Journal of 
Agricultural Education (22.5%) is the most often cited, followed by Educational and 
Psychological Measurement (5.4%), and Journal of Extension (5.3%). Findings also indicate that 
agricultural educators often cite journals from other disciplines, which indicates the 
interdisciplinary nature and diversity of the profession's research and reading characteristics. 

The journals used by scholars and the nature of citation distribution are two key factors that 
determine the structural aspects of a discipline. Further, if a discipline has a strong self-identity, 
the researchers in that discipline build on each other's work. According to Crane (1972), extensive 
cross-referencing by authors in the same area indicates internal bonds, which reflects the structure 
and identity of a discipline. Similarly, if publications in a discipline are easy to locate because they 
only appear in a few journals, the discipline can be considered "compact" Greater compactness 
contributes to a stronger internal structure and self-identity in a discipline (Goldman, 1979, o 
489). F 



Table 3 

Number. Percentage and Rank Ordering of 10 Most Cited Journals bv Year and Total 



YEAR 

Journal 1982 1984 1986 1988 1990 Total Percent/Rank 



/. of Agricultural Education 


3 


13 


13 


22 


34 


85 


22.5/1 


Educational & Psychological 
















Measurement 


1 


2 


2 


3 


12 


20 


5.4/2 


J. of Extension 


3 




2 


8 


o 


19 


5.3/3 


J. of Teacher Education 




1 


3 


3 


8 


15 


3.9/4 


J. of Applied Psychology 




2 


5 


1 


2 


10 


2.6/5 


J. of Vocational Education 
















Research 




1 




3 


6 


10 


2.6/5 


American Vocational 














Journal 




1 


4 




3 


8 


2.1/6 


NACTA Journal 


1 


2 




1 


3 


7 


1.8/7 


Administrative Science 














Quarterly 




4 


3 






7 


1.8/7 


Educational Researcher 






1 


2 


3 


6 


1.6/8 


Adult Education 




4 




2 




6 


1.6/8 


Other Journals 


10 


11 


36 


42 


85 


184 


48.8 



The discipline appears to have a strong self-identity, which suggests that agricultural 
educators tend to build on each other's work. In addition, the agricultural education discipline is 
compact because most of the listed citations are concentrated in three specific journals, the Journal 
of Agricultural Education, Journal of Extension and Educational and Psychological Measurement. 

CONCLUSIONS AND/OR RECOMMENDATIONS 

Journal analysis can provide a means of assessing key factors that usually indicate the 
research and publishing characteristics of a profession. This study attempted to identify the 
characteristics of literature cited by agricultural educators in the Journal cf Agricultural Education. 
Agricultural educators tend to cite journals, followed by books, and reports. 

The discipline of agricultural education appears to have a strong self-identity and 
compactness. This finding suggests that the Journal 's editorial and review boards should consider 
expanding the scope and breadth of the publication. This expansion should involve publishing 
research studies conducted in "non-traditional" topics that are currently pursued by many 
agricultural educators. According to Bowen, Radhakrishna, and Jackson (1991), agricultural and 
extension education faculty have been distributing more of their time to activities that have not 
traditionally been included in JAE. Bowen, et. al. (1991) reported that the respondents to an 
agricultural and extension education faculty survey indicated that they were devoting more time to 
extension education (18.8%), administration (27.1%), and international agricultural education 
(8.6%) activities. 

Agricultural education's narrow focus has been previously addressed by scholars, such 
as Warmbrod (1986), who indicated that despite the fact that agricultural education research has 
"made great strides" during last two decades, we must concentrate on building a stronger 
conce; tual/theoretical framework. Moore (1991) indicated that the profession must be on a 
continuous spiral upward and conduct more theory building research. He also suggested that both 
faculty and graduate students should seriously consider the scope and importance of their research 
topics before publishing. 



ERLC 



5 



On the basis of the data collected in this study, agricultural educators and the Journal of 
Agricultural Education Editorial and Review Board must "branch out" by conducting and 
publishing research in non-traditional areas of agricultural education. The profession must also 
examine and cite more research conducted in other disciplines and incorporate those findings, 
conclusions and recommendations in order to build a stronger framework and continue broadening 
our focus and breadth of knowledge. 



REFERENCES 

Berg, S. (1971). Increasing the efficiency of the economic journal market. Journal of Economic 
Literature. 9. 798-813. 

Bowen, B. E.; Rollins, T. J.; Baggett, C. D.; & Miller, J. P. (1990). Statistical procedures used 
in publishing agricultural education research. Proceedings of the Eastern Region 
Agricultural Education Research Meeting, New Brunswick, 64-71 . 

Bowen, B. E.; Radhakrishna, R. B.; & Jackson, G. B. (1991). Longitudinal assessment of the 
status and job satisfaction of agricultural education faculty. Proceedings of the Eastern 
Region Agricultural Education Resea rch Meeting . Durham, New Hampshire, 1-8. 

Broadus, R. (1952). An analysis of literature cited in the American Sociological Review. 
American Sociological Review. XL 355-357. 

Cox, M. W. (1977). Some changes in articles published in Journal of Applied Psychology during 
a twenty year period. Journal of Applied Psychology . £2, 241-244. 

Crane, D. (1972). Invisible College: Diffusion of knowledge in scientific communities . Chicago: 
The University of Chicago Press. 

Crunkilton, J. R. (1988). Directing future research efforts in agricultural and extension education 
through a matrix. Proceedings of the National Agricultu ral Education Research Meeting . 
St. Louis, 324-346. 

Goldman, A. (1979). A publishing activity in marketing as an indicator of its structure and 
disciplinary boundaries. Journal of Marketing Research . XL 485-494. 

Goldsmith, E. B. (1983). An empirical analysis of the Home Economics Research Journal 
Home Economics Resear ch Journal . H(3), 207-213. 

Hamelman, P. W., & Mazze, E. M. (1972). On the impact of management science. Interfaces . 2, 
8-17. 

Mannebach, A. J.; McKenna, P. G.; & Pfau Geeta (1984). An analysis of research methodology 
used in agricultural education, 1974-82. Proceedings of the Conference in Agricultural 
Education . Sturbridge, 112-129. 

Moore, G. (1991). How firm the foundation? A look at the knowledge base in agricultural 

education research. Proceedings of the National Agricultura l Education Research Meeting. 
Los Angeles, 151-157. 

Narin, F.; Carpenter, M.; & Berlt, N. (1972). Interrelationships of Journals. Journal of American 
Society of Inf ormation Science . 22, 32223-31. 



ERLC 



Newman, M.E. (1990). Reader opinions of The Journal of Agricultural Education. Proceedings 
of the National Agricultural Education Research Meeting. Cincinnati, 266-272. 

Radhakrishna, R. B. & Jackson, G. B. (1992). Journal of Agricultural Education: An empirical 
analysis. Proceedings of the Eastern Region Agricultural Educ ation Research Meeting , 
Annapolis, Maryland, 50-57. 

Warmbrod, J. R. (1986). Priorities for continuing progress in research in agricultural education. 
Proceedings of Southern region research conferen ce in agricultural education. March 22- 
24, 1986, Litde Rock, Arkansas. 

Williams, D. L. (1982). Results of the AATEA Journal readability survey. Report to the Editing- 
Managing Board of the AATEA Journal. 

Wind, J. (1977). New Directions for JCR. Journal of Consumer Research . 4. 59-60. 



ERIC 



6 



